Synchronized bursts following instability of synchronous spiking in chaotic neuronal 

networks 
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We report on the origin of synchronized bursting dynamics in various networks of neural spiking 
oscillators, when a certain threshold in coupling strength is exceeded. These ensembles synchronize 
at relatively low coupling strength and lose synchronization at stronger coupling via spatio-temporal 
intermittency. The latter transition triggers multiple-timescale dynamics, which results in synchro- 
nized bursting with a fractal-like spatio-temporal pattern of spiking. Implementation of an appro- 
priate technique of separating oscillations on different time-scales allows for quantitative analysis of 
this phenomenon. We show, that this phenomenon is generic for various network topologies from 
regular to small-world and scale-free ones and for different types of coupling. 
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Achievements of the recent decade have given strong 
evidence that synchronous activity 0] plays an important 
role in the functioning of the nervous system and brain 
■ These examples range from coordinating movements 
in the motor system to information processing (recog- 
nition and perceptual binding) in the visual cortex and 
olfactory system. On the other hand, synchronization 
may play a destructive role, causing neural disorders like 
epileptic seizures or Parkinson's disease 0|. Moreover, 
the importance of desynchronization in cognitive process- 
ing is increasingly being recognized 

The need for the theoretical explanation of these find- 
ings stimulated extensive research in the field of nonlin- 
ear dynamics. The most simple and liable to analysis 
models of integrate- and-fire neurons, which mimic pe- 
riodic subthreshold approach to the spiking state, were 
extensively studied to elucidate perfect synchronization 
between identical units and frequency synchronization 
between non-identical ones The recently developed 
theoretical framework for chaotic synchronization paved 
the way to analyzing cooperative dynamics of more real- 
istic models of chaotically spiking and bursting neurons 
Q. Complete chaotic synchronization in small and large 
ensembles of identical neurons was found and methods of 
its prediction were developed Q. 

However, in nature neurons are not identical. There- 
fore, the functional interdependence between momentary 
states of synchronized neurons, if any, becomes extremely 
complex and difficult to identify, especially in large en- 
sembles Q. At the same time, as chaotic synchronization 
has been observed in a variety of small groups of non- 
identical neurons 0| , it gives strong grounds to expect it 
to appear in large ensembles too. 

A promising way to make an advance here is the con- 
cept of chaotic phase synchronization (CPS) It im- 
plies the adjustment of characteristic time-scales of non- 
identical oscillators in course of interaction. Given an ap- 
propriate definition of phase and frequency one obtains 



an efficacious tool for detecting this process. Neurons, 
known as multiple-time-scale systems, can generate ei- 
ther single spikes mediated by long intervals of silence, 
or trains of spikes, coined bursts. Remarkably, as we have 
recently shown, it is possible to identify phase synchro- 
nization on the bursting time-scale, while oscillations on 
the spiking time-scale are unsynchronized 

In this Letter we study the pathway to the formation 
of synchronized bursting in networks of intrinsically spik- 
ing neurons. We show that it is observed with increase 
of interneuronal coupling, as the networks achieve syn- 
chronous spiking, undergo its instability towards gener- 
ation of bursting, which finally synchronizes. We ana- 
lyze this phenomenon basing on the CPS concept and 
develop a proper technique to separate oscillations on 
spiking and burtsting time-scales. We demonstrate, that, 
when the CPS regime gets unstable, spatio-temporal in- 
termittency excites oscillations on the fast time-scale 
(FTS), and eventually leads to the regime of synchro- 
nized bursts with a fractal-like spatio-temporal structure 
of the spikes. Simulations of scale-free, random, and 
small-world topologies give evidence of ubiquity of this 
phenomenon in complex neuronal networks. 

We consider networks of non-identical neuronal model 
maps, proposed in [l^ : 
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where Xj and yj are the fast and slow variables respec- 
tively, j = l,N. In all simulations we use fj, = 10~ 3 , 
a = 3.5, q G [0.15,0.16] (a uniform random distribu- 
tion) that provides chaotic spiking in an isolated map; 
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FIG. 1: Space-time plots illustrate different regimes that oc- 
cur in the chain Xj values are represented by grey scale, 
white corresponds to minimal values, black to maximal ones. 
Shown are (a) unsynchronized spiking, e = 0.01, (b) syn- 
chronized spiking, e = 0.05, (c) desynchronized state: syn- 
chronization is occasionally broken by fast repetitive spikes, 
£ = 0.1, (d) synchronized bursts with a fractal-like spatio- 
temporal structure of spikes, e = 0.2. 



e is the coupling strength, Ki is the number of entries 
in the i-th neuron. The sum is taken over all neigh- 
bours of a neuron in the network; all connections are 
reciprocal. The coupling function corresponds either to 
electrical Gvj = Xj — xf, or synaptical excitatory cou- 
pling Gift — (x rp — Xi)x{xj), here the reversal potential 
x rp — 1, x( x ) = 1 if £C > 0, and x( x ) = otherwise. 

To analyze the collective dynamics of this neural en- 
semble in terms of CPS one has to introduce frequency 
and phase characteristics of oscillations. For spiking dy- 
namics we determine the average spiking frequency in 
neuron j by: 



■jj = lim n^/k, 



(3) 



where is the number of spikes fired from the beginning 
up to the discrete time k. The phase of spiking reads: 



$ = 2^ 



2-Krrij , kj jn < k < k 
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kj.m being the moment of the m-th spike in neuron j. 

Further on, we need the other characteristics, which 
correctly describe the slow time-scale (STS) oscillations 
in the bursting regime. The STS frequencies Qj and 
phases $j are defined similar to their spiking time-scale 
counterparts Wj <EJ| and ifj Q , except that not each spik- 
ing event contributes to the 2ir growth, but only the first 
one in a burst (in simulations, the one coming after at 
least 80 iterations in silent state). Note, that while neu- 
rons generate STS chaotic spiking (like for e = 0), both 
definitions are equivalent. If fast repetitive spikes form 
trains of bursts, Vtj will characterize the bursting fre- 
quency and u>j will characterize the average spiking fre- 
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FIG. 2: Variances of slow time-scale (STS) and spiking fre- 
quencies fij and LUj over the chain £Q| vs. coupling strength 
e for different chain sizes TV. 



quency. This technique allows for a correct separation of 
the FTS and STS. 

Now we summarize the regimes that occur for differ- 
ent coupling strengths e in a regular chain of electri- 
cally coupled neurons At low coupling neuronal 
firings are unsynchronized (FigOJa)), at moderate cou- 
pling they get synchronized (FigQJb)). As we increase 
e, the CPS regime becomes unstable and neurons start 
firing fast repetitive spikes occasionally (FigQJc)). Fur- 
ther increase of e results in synchronized bursts with a 
fractal-like spatio-temporal structure of spikes (FigEId)) 

H3- 

To quantify these transitions we have computed the 
variances of the STS and spiking time-scale oscillations 
frequencies vs. the strength of the electrical coupling 
for the chain lengths N = 200, 400, 800 (FigEJ. We 
find three size- independent critical coupling strengths: 
El w 0.035, £2 ~ 0.07, and e rs 0.15, which define four 
intervals: (i) for e € [0, £1] oscillations on the single ex- 
isting time-scale - the slow one - are unsynchronized, (ii) 
for £ e [ei,£2] oscillations on the STS are synchronized, 
(iii) for £ £ [£2, £3] oscillations on the second time-scale - 
the fast one - are initiated, both time-scales demonstrate 
unsynchronized oscillations, (iv) and for large coupling 
£ > £3 oscillations on the STS get synchronized again, 
oscillations on the FTS are still unsynchronized. 

The transition to CPS at £1 is what one would have 
intuitively expected a priori, as long as this is a conven- 
tional way how arrays of non-identical oscillators behave 
PJ, but the instability of CPS at £2 and the generation 
of the FTS by repetitive spikes further on demand a de- 
tailed study. To uncover the nature of this transition, we 
record the interspike intervals T s in each neuron and plot 
their evolution for different coupling strengths (FigEJ. 
For £ < £2 we observe that chaotic spikes construct only 
the STS (T a > 100), be it unsynchronized (FigEJa)) or 
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FIG. 3: Evolution of interspike intervals for (a) e = 0.01, (b) 
e = 0.05, (c) £ = 0.073 In (c) we denote several intervals of 
stability windows Tl- 



synchronized (FigOJb)) dynamics. Note that in the syn- 
chronization regime the relative spike timing in neurons 
is locked but not tightly fixed. It varies from one spik- 
ing front to another one exhibiting flexibility of phase, 
typical of genuine CPS (see the inset in FigGJb)). T s se- 
quences (FigOJc)) demonstrate the intermittent nature 
of the developing instability. The time intervals, during 
which fast repetitive spikes are generated, are interrupted 
by windows of synchronized STS spiking (in FigOJc) one 
of them lasts as long as Tl ~ 10, 000 iterations, which is 
of the order of 100 STS interspike intervals). The closer 
e is to £2, the larger become stable CPS windows Tl- 
In FigQJa),(b) we show statistical properties of inter- 
spike intervals T s and time durations of stable windows 
Tl, respectively. Remarkably, the probability distribu- 
tions of Tl demonstrate a power-law dependence over 
five decades in a finite interval of the coupling strength 
with e-dependent exponents. 

The shown complexity arises on the micro-scale, when 
a spike in an adjacent neuron makes a just fired neu- 
ron fire again (FiglUc)) should the coupling be strong 
enough. It is important to underline the principal role 
of the individual dynamics of oscillators in synchroniza- 
tion and desynchronization processes. In the classical 
case of coupled quasiharmonic oscillators the variables 
change smoothly and the coupling tries to synchronize 
the systems all the time. In case of spiking neurons, the 
coupling synchronizes them until the faster neuron fires. 
Its firing is also a synchronizing event, as it pushes the 
slower oscillator up. On the opposite, firing of the slower 
neuron desynchronizes them, as it pushes the faster one 
up towards the next firing. Varying s we change the 
balance between synchronization and desynchronization 
and observe the instability of synchronization when short 
desynchronizing intervals prevail. 

In addition, we implemented synaptical excitatory cou- 
pling instead of the electrical one and found no qualitative 
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PIG. 4: Probability distributions of (a) interspike intervals 
P(T S ) and (b) duration of stable CPS windows P(Tl) for dif- 
ferent values of the coupling strength (solid lines are guides 
for the eye), (c) Dynamics of fast variables Xj in three neigh- 
boured neurons. It is shown, how a spike in the 28-th neuron 
makes the 27-th neuron (bold line) fire a repetitive spike. 



difference with respect to the shown effects. We would 
like to stress that the observed instability of the syn- 
chronous regime is not an artefact of a time-discrete sys- 
tem. We have observed it in ensembles of non-identical 
Hindmarsh-Rose neuronal oscillators too 

Next we study whether these results are valid in com- 
plex neuronal networks with a long-range synaptic con- 
nectivity that is typical of biological ensembles. In 
the following we implement two types of complex topolo- 
gies: scale-free and small- world ones 0|- ® m inter- 
est in such networks has been additionally stimulated 
by the recent study ^3], that reported scale-free prop- 
erties of functional brain networks (with the exponent 
varying from 2.0 to 2.2). The scale-free network, we sim- 
ulate, is characterized by the node degree distribution 
P(K) tx -FT~ 7 ,7 = 2.2, and the mean < K >« 4.2. The 
small-world network has on the average 10 links per neu- 
ron and the probability of rewiring a short-range regular 
link is p = 0.1. The results of the simulations (FigEIa,b)) 
demonstrate the same scenario of the onset of bursting 
via instability of synchronized chaotic spiking. This sim- 
ilarity becomes quite natural, as one takes into account, 
that fast repetitive spiking is the result of interaction of 
two neighbours, which fire with a mismatch in time, as 
discussed above. Thus, the neighbour-to-neighbour inter- 
actions, and not the global architecture, are important. 

What for topology does matter, is the global coher- 
ence. Having in mind, that precise timing of synchro- 
nized oscillations in biological ensembles is considered to 
be a functional means in cognitive tasks Q, we calculate 
the order parameter (as a measure of coherence) for the 
STS oscillations: p — \J2 e ** J ' l> FigEtc). In complex net- 
works with long-range connectivity STS firing is tightly 
locked within 10 time durations of a single spike, while in 
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FIG. 5: Variances of (a) STS and (b) spiking frequencies Clj 
and and (c) the order parameter of the STS oscillations p 
vs. excitatory coupling strength for local coupling (LC), scale- 
free (SF), and small- world (SW) network topologies. Here 
N = 200 and all data are averaged over 100 realizations of 
network topologies and random parameters of individual neu- 
rons. 



locally coupled ensembles the global coherence is absent 
(FigGJc)|3Ib)). Thus the long-range coupling strength, 
subjected to synaptic plasticity, appears to be a plau- 
sible way for dynamical altering between coherent and 
non-coherent performance, suggesting, in turn, a mecha- 
nism for information processing in biological networks. 

In summary, we have shown that ensembles of non- 
identical neurons generate an instability of synchronous 
chaotic spiking, as the coupling strength is increased. 
Arising spatio-temporal intermittency gives birth to 
bursting dynamics, which at stronger coupling becomes 
synchronous. This phenomenon has proved to be generic 
with respect to the type of coupling and network archi- 
tecture. Beside general interest from the viewpoint of 
theoretical nonlinear dynamics, these findings may di- 
rectly apply to neurobiological systems, indicating, that 
(i) excessive coupling does not necessarily improve syn- 
chrony of spiking, and (ii) the population dynamics can 
serve a mechanism behind bursting, complementary to 
variation of individual parameters and ionic mechanisms 
[lflj . And we strongly expect the reported effects to be 
observed in biological experiments. 
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